UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (When  Date  Entered) 

REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

1.  report  number  NAVENVPREDRSCHFAC 
Contractor  Report  CR  83-01  (a) 

2.  GOVT  ACCESSION  NO. 

3.  RECIPIENT'S  CATALOG  NUMBER 

4.  TITLE  (end  Subtitle) 

5.  TYPE  OF  REPORT  ft  PERIOD  COVERED 

Satellite  Moisture  Retrieval  Techniques 

Final 

Volume  1:  Technique  Development  and  Evaluation 

«.  PERFORMING  ORG.  REPORT  NUMBER 

7.  AUTHOR^; 

(.  CONTRACT  OR  GRANT  NUMBERS 

A.  Rosenberg,  D.B„  Hogan,  C.K.  Bowman 

N00228-81 -C-Hl 56 

9.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

RCA  Government  Systems  Division 

Astro-Electronics 

Princeton,  NJ  08540 

10.  PROGRAM  ELEMENT.  PROJECT.  TASK 

AREA  &  WORK  UNIT  NUMBERS 

PE  62759N  PN  SF59-553 

NEPRF  WU  6.2-13 

11.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

Naval  Air  Systems  Command 

12.  REPORT  DATE 

January  1983 

Department  of  the  Navy 

Washington,  DC  20361 

12.  NUMBER  OF  PAGES 

96 

“U.  MONITORING  AGENCY  NAME  4  ADDRESS  (if  different  from  Controlling  Office) 

15.  SECURITY  CLASS,  (of  thie  report) 

Naval  Environmental  Prediction  Research  Facility 

UNCLASSIFIED 

Monterey,  ca  yjy^u 

15«.  DECLASSIFICATION/DOWNGRADING 

SCHEDULE 

16.  DISTRIBUTION  STATEMENT  (ol  t hi*  Report) 

Approved  for  public  release;  distribution  unlimited 

17.  DISTRIBUTION  STATEMENT  (of  the  abstract  entered  in  Mfeek  20,  if  different  from  Report) 

18.  SUPPLEMENTARY  NOTES 

See  also  Satellite  Moisture  Retrieval  Techniques  VOLUME  2: 

Atmospheric  Sounding  Bibliography  --  NAVENVPREDRSCHFAC 

CR  83-01 (b)  —  for  listings  developed  by  literature  search 

in  the  subject  area. 

19.  KEY  WORDS  (Continue  on  reveree  eldo  if  necessary  end  Identity  by  block  number) 

Satellite  meteorology 

Radiative  transfer 

Water  vapor  retrieval 

Remote  sensing 

20.  ABSTRACT  (Continue  on  reveree  eide  if  neceeeary  end  identify  by  block  number) 

The  water  vapor  channels  of  the  Special  Sensor  H-2  (SSH/2)  of  the  Defense 
Meteorological  Satellite  Program  (DMSP)  are  analyzed,  and  their  ability  to 
retrieve  vertical  profiles  of  moisture  is  studied. 

The  sensitivity  in  the  measured  radiance  for  each  channel  to  changes  in 
water  vapor  amount  made  at  levels  throughout  the  troposphere  is  calculated.  It 
is  determined  that  the  ability  of  the  SSH/2,  and  indeed  of  any  infrared  sensor, 
to  estimate  the  water  vapor  at  levels  near  the  surface  is  severely  limited. 

DD  1  j  ANM73  1473  EDITION  OF  1  NOV  65  IS  OBSOLETE 

UNCLASSIFIED 

SECURITY  CL  ASSI  FlCATION  OF  THIS  PAGE  (When  Detm  Entered) 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  PAOEf'HTun  Dmtm  EnHnifl 


Block  20,  Abstract,  continued. 


A  statistical  retrieval  technique  that  relies  on  correlations  of 
atmospheric  humidity  with  the  observed  SSH/2  radiances  and  estimates  of  the 
tropospheric  temperatures  is  used  to  provide  a  first  guess  estimate  of  the 
moisture  profile„  This  first  guess  profile  is  then  corrected  using  a  physical 
approach  that  inverts  the  radiative  transfer  equation.  For  a  sample  set  of 
mid-latitude  profiles  this  statistical-physical  technique  yields  fraction  root 
mean  squared  errors  of  about  25%  for  the  region  400-700  mb,  with  errors  of 
about  35%  for  regions  nearer  the  surface. 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGEl'H'Mfi  D«(«  Enffd) 


ROUTINE  REPLY,  ENDORSEMENT,  TRANSMHTAL  OR  INFORMATION  SHEET 

OPNAV  5216/158  (Rev.  7/0)  A  WISDUW  l\\  H.on-MA  Y  lUi  USM) 

SN  0107  I  F  052  1691  Conner h  A'.*1 1  t.AOS  .1 7HV 


C  LA  SSI  I  I C  AT!  O  N  (UNCl.ASSll'IED  when 
detached  from  enclosures,  unless  otherwise 
indicated) 


FROM  {Show  / 1  (epho/ic  monfnr  in  addition  to  address) 

Commanding  Officer,  Naval  Environmental  Prediction  Research 
Facility,  Monterey,  CA  93940  AVN  878-2928 


UNCLASSIFIED 


DATE 


15  March  1983 


SUBJECT 

NAVENVPREDRSCHFAC  technical  publication;  forwarding  of 


SERIAL  OR  FILE  NO. 

NAVENVPREDRSCHFAC/SBB:sb 
5600  SER  :  102 


TO: 


REFERENCE 


Distribution 

[See  pp  Dist-l--3,  Enel  (1),(2)] 


ENCLOSURE 

NAVENVPREDRSCHFAC 


m 


Contractor  Report  CR  83-01  (a): 
Satellite  Moisture  Retrieval 
Techniques,  Vol  1 ,  Technique 
Development  and  Evaluation 


VIA: 


ENDORSEMENT  ON 


(2)  CR  83-01  (b):  Vol  2, 
Atmospheric  Sounding 
Bibl iography 


FORWARDED 


□ 


RETURNED 


□  FOLLOW  UP,  OR 

* 


TRACER 


n 


REQUEST 


SUBMIT 


□ 


CERTIFY 


□  MAIL  !  I  FILE 


GENERAL  ADMINISTRATION 


CONTRACT  ADMINISTRATION 


PERSONNEL 


XX 


FOR  APPROPRIATE  ACTION 


UNDER  YOUR  COGNIZANCE 


information  &  retontion 


NAME  &  LOCATION  OF  SUPPLIER 
OF  SUBJECT  ITEMS 


SUBCONTRACT  NO.  OF  SUBJECT  ITEM 


REPORTED  TO  THIS  COMMAND 


APPROVAL  RECOMMENDED 
YES  NO 


□ 


APPROPRIATION  SYMBOL,  SUBHEAD, 
AND  CHARGEABLE  ACTIVITY 


DETACHED  FROM  THIS  COMMAND 


□ 


□ 


DISAPPROVED 


SHIPPING  AT  GOVERNMENT  EXPENSE 
f  J  YES  NO 


OTHER 


COMMENT  AND/OR  CONCURRENCE 


A  CERTIFICATE,  VICE  BILL 
OF  LADING 


LOANED.  RETURN  BY: 


COPIES  OF  CHANGE  ORDERS, 
AMENDMENT  OR  MODIFICATION 


SIGN  RECEIPT  &  RETURN 


CHANGE  NOTICE  TO  SUPPLIER 


REPLY  TO  THE  ABOVE  BY: 


STATUS  OF  MATERIAL  ON 
PURCHASE  OOCUMENT 


REFERENCE  NOT  RECEIVED 


REMARKS  {Continue  on  reverse) 


SUBJECT  DOCUMENT  FORWARDED  TO 


SUBJECT  DOCUMENT  RETURNED  FOR- 


Enclosure  (1)  documents  a  sensitivity  study  of  the 


SUBJECT  DOCUMENT  HAS  BEEN 
REQUESTED.  AND  WILL  BE 
FORWAROED  WHEN  RECEIVED 


DMSP  SSH/2  water  vapor  channels,,  Enclosure  (2)  is  a 
bibliography  of  the  field  of  remote  sensing  of  atmos¬ 
pheric  temperature  and  water  vapor. 


COPY  OF  THIS  CORRESPONDENCE 
WITH  YOUR  REPLY 


ENCLOSURE  NOT  RECEIVED 


ENCLOSURE  FORWARDED  AS  REQUESTED 


ENCLOSURE  RETURNED  FOR 
CORRECTION  AS  INDICATED 


CORRECTED  FNCL  ITSUKF  AS  REQUESTED 


REMOVE  FflQ M  DlLITflllllJTIQN  LIST 


HI  GUCEZ  DISTRIBUTION  AMOUNT  TO 


COPY  TO 


Commanding  Officer 


Cl  \SSII  K  A'llOM/AC/.  I.V.S7///7J  «7«;/ 
detai  hed  innn  enclosures,  unless  ot/n  rwise 


unfit  ated) 


UNCLASSIFIED 


*  G.P.O.:  1979-689  01 6/4281 


NAVENVPREDRSCHFAC  CR  83  01  {a 


NAVENVPREDRSCHFAC 
CONTRACTOR  REPORT 
CR  83-01  (a) 


I 


UBRARY 

RESEARCH  REPORTS  DIVISION 
NAVAL  POSTGRADUATE  SCHOOL 
MONTEREY.  lALIFGRWA  93940 


SATELLITE  MOISTURE  RETRIEVAL  TECHNIQUES 

VOLUME  1 

TECHNIQUE  DEVELOPMENT  AND  EVALUATION 


Prepared  By: 

A.  Rosenberg,  D.  B.  Hogan,  and  C.  K.  Bowman 

it  RCA  Government  Systems  Division, 
Astro-Electronics,  Princeton,  New  Jersey  08540 

> 

% 

Contract  No.  N00228-81-C-H1 56 


JANUARY  1983 


APPROVED  FOR  PUBLIC  RELEASE 
DISTRIBUTION  UNLIMITED 


Prepared  For: 

NAVAL  ENVIRONMENTAL  PREDICTION  RESEARCH  FACILITY/ 
MONTEREY,  CALIFORNIA  93940 


TABLE  OF  CONTENTS 


Section  Page 

1.0  SUMMARY  OF  WORK 

1.1  Introduction  1-1 

1.2  Extensive  Literature  Search  1-2 

1.3  Water  Vapor  Profiles  from  Passive  Sounders  1-3 

1.4  Evaluation  of  Selected  Retrieval  Techniques  1-4 

2.0  EXTENSIVE  LITERATURE  SEARCH 

2.1  Computerized  Publications  Search  2-1 

3.0  ANALYSIS  OF  DMSP  SSH/2  SOUNDER 

3.1  Description  of  Instrument  and  Weighting 

Functions  3-1 

3.2  Sensitivity  Calculations  3-13 

3.3  Lack  of  Upper  and  Lower  Atmospheric 

Sensitivity  3-16 

4.0  OUTLINE  OF  STUDY  PLAN 

4.1  Implications  of  Sensitivity  Study  4-1 

4.2  Statistical  Inversion  4-2 

4.3  Non-linear  Relaxation  Correction  4-5 

4.4  Simulation  Techniques  4-6 


l 


TABLE  OF  CONTENTS  (CONTINUED) 


Section  Page 

5.0  STATISTICAL  FIRST  GUESS 

5.1  Smith-Woolf  Technique  5-1 

5.2  First  Guess  Program  Implementation  5-3 

5.3  Evaluation  of  First  Guess  Results  5-7 

5.4  First  Guess  Program  Results  5-8 

6.0  PHYSICALLY  BASED  RETRIEVALS 

6.1  Introduction  6-1 

6.2  Fixed  Level  Correction  Method  6-3 

6.3  Relaxation  in  the  Space  of  EOF's  6-7 

6.4  Relaxation  Algorithm  Results  6-11 

7.0  CONCLUSIONS  7-1 

Appendix  A  RAPID  ALGORITHM  FOR  SSH/2  TRANSMITTANCES 

A- 1  Introduction  A-l 

A-2  Generation  of  the  Dependent  and  A-2 

Independent  Transmittance  Data  Sets 

A- 3  Linear  Regression  Model  A- 4 

A- 4  Generation  and  Testing  of  the  Rapid  A-6 

Algorithm  Coefficients 

A- 5  Summary  A- 9 

ii 


TABLE  OF  CONTENTS  (CONTINUED) 


Section 

Page 

Appendix  B  REFERENCES 

B-l 

Distribution 

Dist-1 

iii 


Acknowledgements 


The  authors  wish  to  give  special  thanks  to  M.  T.  Chahine  for 
his  many  valuable  contributions  made  throughout  this  study. 

We  thank  T.  J.  Kleespies  for  his  helpful  comments  and  careful 
review  of  this  manuscript,  and  R.  D.  Haskins  who  participated 
in  many  stimulating  discussions.  We  are  also  grateful  to 
M.  Pfann,  who  assisted  us  with  her  valuable  expertise  in 
computer  based  literature  searches. 


IV 


SECTION  1.0 


SUMMARY  OF  WORK 


1.1  INTRODUCTION 

Knowledge  of  the  vertical  structure  of  water  vapor  in  the 
atmosphere  is  important  for  many  aspects  of  atmospheric  science, 
ranging  from  numerical  weather  forecasting  to  climate  studies  to 
the  prediction  of  severe  storms.  Satellites  provide  an  ideal 
platform  for  monitoring  the  atmospheric  water  vapor  content 
because  of  their  global  (in  the  case  of  polar  orbiters)  or 
continuous  (in  the  case  of  geosynchronous  satellites)  coverage. 
Infrared  sounders  on  past,  present,  and  proposed  satellites 
contain  water  vapor  channels  from  which  information  on  the  H2O 
content  of  the  atmosphere  can  be  extracted;  however,  attempts  to 
date  to  derive  accurate  H2O  profiles  have  met  with  limited 
success  . 

This  is  a  report  on  NEPRF  Contract  N00228-81-C-H156  "Satellite 
Moisture  Retrieval  Techniques"  whose  purpose  is  to  develop 
techniques  to  obtain  moisture  profiles  from  satellite 
observations.  This  report  consists  of  two  volumes.  Volume  I 
gives  the  development  of  the  retrieval  technique  and  its  eval¬ 
uation.  Volume  II  gives  a  bibliography  of  papers  on  satellite 
moisture  and  temperature  retrievals.  Volume  I  is  organized  as 
follows:  Section  1  gives  a  summary  of  the  work.  Section  2 

describes  the  data  base  used  for  an  extensive  literature  search 
that  is  compiled  in  Volume  II.  In  Section  3  the  eight  water 
vapor  channels  of  the  SSH/2  sounder  are  analyzed  in  detail. 
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Section  4  outlines  our  plan  to  develop  the  retrieval  technique. 

In  Section  5  a  statistical  retrieval  method  is  developed  and  its 
accuracy  evaluated.  In  Section  6  a  relaxation-iteration  retrieval 
technique  is  implemented,  using  the  statistical  retrieval  as  a 
first  quess,  and  the  accuracy  of  the  combined  statistical-physical 
scheme  is  assessed.  The  conclusions  of  the  work  are  drawn  in 
Section  7. 

1.2  EXTENSIVE  LITERATURE  SEARCH 

The  purpose  of  the  literature  search  is  to  determine  the  state-  > 
of-the-art  in  H20  soundings  and  to  provide  a  data  base  for 
future  research  on  the  subject.  Material  for  the  literature 
search  was  drawn  from  two  computer  data  bases  as  well  as  the 
recently  published  literature.  The  results  of  the  literature 
search,  which  included  temperature  as  well  as  water  vapor 
sounding  techniques,  were  tabulated  and  cross  referenced.  The 
references  were  listed  in  several  forms: 

-  By  year  of  publication  (this  is  the  master  list) 

-  By  subject 

-  By  satellite  instrument 

Based  on  the  outcome  of  the  literature  search  it  was  decided 
to  investigate  the  SSH/2  sounder  flown  onboard  the  DMSP  series 
of  polar  orbiting  satellites.  The  SSH/2  is  a  passive  infrared 
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radiometer  with  eight  H20  channels.  It  was  selected  for  two 
reasons : 

-  Techniques  developed  for  the  SSH/2  to  determine  water 
vapor  could  be  adopted  for  operational  use  relatively 
quickly. 

-  The  SSH/2  has  the  largest  number  of  water  vapor  channels 

of  any  current  sounder  —  which  should  allow  retrievals  from 
a  diverse  range  of  atmospheres. 

1.3  WATER  VAPOR  PROFILES  FROM  PASSIVE  SOUNDERS 

Following  the  literature  search,  the  theory  of  passive  atmospheric 
constituent  retrievals  was  evaluated  with  an  emphasis  on  the 
infrared  region.  A  sensitivity  study  of  the  SSH/2  was  then  per¬ 
formed  to  determine  the  response  of  each  H20  channel  to  a  change 
in  water  vapor  amount  at  levels  throughout  the  troposphere.  In 
addition,  two  types  of  "weighting  functions"  were  calculated  and 
plotted  to  aid  in  selection  of  possible  retrieval  methods. 

It  was  concluded  that  H20  channels  alone  do  not  contain  enough 
information  to  allow  retrievals  down  to  the  surface  layers. 

If  water  vapor  at  the  lowest  levels  is  desired,  then  either 
other  measurements  must  be  used  (e.g.,  active),  or  statistical 
relationships  must  be  derived.  A  statistical  technique,  the 
Smith-Woolf  Eigenvalue-Eigenvector  Technique^,  was  selected  to 
provide  a  first  guess  estimate  of  the  tropospheric  water  vapor 
structure.  It  employs  as  independent  variables  (1)  brightness 
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temperatures  obtained  from  the  H2O  channels  and  (2)  tropo¬ 
spheric  temperatures  at  various  levels  (which  could  in  practice 
be  determined  from  CO2  sounding  channels).  The  water  vapor 
amounts  at  the  different  tropospheric  levels  are  the  dependent 
variables . 

Due  to  the  high  sensitivity  of  most  of  the  H2O  channels  to 
middle  tropospheric  water  vapor  changes,  it  was  felt  that  the 
statistically  derived  profiles  could  be  improved  in  this  region 
by  correcting  with  a  nonlinear  relaxation  technique  based  upon 
inverting  the  radiative  transfer  equation.  Two  relaxation 
techniques  were  considered:  (1)  based  on  the  Chahine^ 

method  of  correcting  at  selected  levels  of  the  atmosphere  and 
interpolating  between  them  using  various  techniques;  and 
(2)  inverting  the  H2O  channel  radiances  to  obtain  a  temperature 
profile  in  terms  of  an  integrated  water  vapor  amount  to  that 
level  and  mapping  to  a  temperature  profile  obtained  in  pressure 
space^  (the  U-Space  Retrieval  Technique)  . 

1.4  EVALUATION  OF  SELECTED  RETRIEVAL  TECHNIQUE 

The  Chahine  type  retrieval  method  was  selected  for  further 
development  and  a  simulation  study  was  designed  to  test  it. 

A  set  of  1200  profiles  of  temperature  and  water  vapor  was 
obtained  from  NOAA/NESS,  and  divided  into  three  equal  groups 
of  400  profiles  from  mid-latitude,  arctic,  and  tropical  climate 
regions  respectively.  Radiances  were  simulated  for  each  pro¬ 
file  for  the  eight  water  vapor  channels  of  the  SSH/2,  using  a 
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rapid  transmittance  algorithm.  This  rapid  algorithm  was  generated 
from  "exact"  line-by-line  calculations  and  is  discussed  in 
Appendix  A.  Random  noise  was  added  to  each  observation  and  each 
climatological  group  was  divided  into  subsets  of  dependent  and 
independent  profiles.  The  dependent  profiles  were  used  to  derive 
the  linear  prediction  matrix  of  the  Smith-Woolf  technique,  while 
the  independent  set  was  used  to  test  the  accuracy  of  the  statisti¬ 
cal  first  guess,  and  the  improvement  offered  by  the  relaxation 
algorithm . 

The  results  of  simulation  studies  show  that  the  fractional  RMS 
error  is  about  35%  for  mid-latitude  profiles  for  the  statistical 
first  guess.  In  the  region  400  mb-700-mb  the  functional  RMS 
error  was  reduced  to  about  25%  by  a  relaxation  technique. 
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SECTION  2.0 


EXTENSIVE  LITERATURE  SEARCH 

2 . 1  COMPUTERIZED  PUBLICATIONS  SEARCH 

The  computer  search  was  initiated  by  scanning  the  Department 
of  Commerce  NTIS  (National  Technical  Information  Service)  Data 
Base  and  the  INSPEC  file  of  Lockheed's  DIALOG  Data  Base.  The 
NTIS  Data  Base  consists  of  reports  resulting  from  government 
contracts  and  technical  reports  issued  by  government  agencies. 

The  Lockheed  Data  Base  consists  of  citations  from  technical 
journals.  The  initial  scan  was  supplemented  from  personal  files. 

The  Data  Bases  contained  only  material  published  during  or  after 
1967.  From  examining  references  in  the  papers  cited,  and  from 
information  in  personal  files,  it  was  concluded  that  very  few 
pre-1967  references  were  relevant  to  this  study.  However,  three 
pre-1967  papers  (Kaplan4,  King3,  and  Wark  and  Fleming5) 
were  deemed  to  be  important  because  they  formed  the  basis  for 
most  of  the  satellite  retrieval  work  that  followed.  The  full 
literature  survey  is  given  in  Volume  II.  Section  1  presents  the 
entire  bibliography  chronologically.  Section  2  is  classified  by 
subjects  and  Section  3  is  classified  by  instruments. 

The  literature  search  covers  the  techniques  of  water  vapor 
retrieval  as  well  as  of  temperature  retrieval,  because  both 
techniques  employ  similar  methods  and  instruments. 
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The  retrieval  studies  conducted  in  parallel  with  the  literature 
search  had  yielded  definite  results  on  the  limitations  of  any 
single  instrument.  In  particular, 

(a)  No  single  instrument  discovered  has  the  capability  of 
retrieving  water  vapor  content  throughout  the  atmosphere 
with  high  vertical  resolution. 

(b )  A  combination  of  instruments  is  required  to  measure  H2O 
amount  at  low  levels  (see  Section  3.2).  Probably  coincident 
microwave  and  IR  soundings  will  be  necessary. 

With  the  above  limitations  on  the  capability  of  any  single 
instrument,  it  is  possible  to  conclude  from  the  literature  search 
that  the  best  single  sounding  instrument  for  moisture  retrievals 
is  the  SSH/2 . 
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SECTION  3.0 


ANALYSIS  OF  DMSP-SSH/2  SOUNDER 

3.1  DESCRIPTION  OF  INSTRUMENT  AND  WEIGHTING  FUNCTIONS 

The  SSH/2  infrared  sounder6  aboard  the  DMSP  satellite  contains 
eight  water  vapor  sounding  channels:  seven  in  the  18-28  yin  region 
and  one  centered  at  12.5  ym.  Table  3.1  gives  the  central  fre¬ 
quencies  and  bandwidths  of  these  channels.  A  plot  of  the  filter 
response  functions  <t>i(v)  for  the  H2O  channels  (7-14)  is  given 
in  figure  3.1.  The  channels  are  all  broadband  with  a  significant 
degree  of  overlap  in  the  spectral  bandpasses  for  the  18-28  ym 
region . 

The  transmission  properties  of  the  atmosphere  for  the  SSH/2 
were  analyzed  using  a  line-by-line  transmission  program 
obtained  from  the  Goddard  Laboratory  for  the  Atmospheric  Sciences7 
and  modified  at  RCA.  The  calculations  utilize  the  AFGL  Line 
Compilation  tape  (1980  version)8  which  includes  line  parameters 
for  the  gases  H20,  C02 ,  03 ,  N20,  CO,  CH4  and  02 .  Water  vapor 
was  the  largest  contributor  to  absorption  for  all  SSH/2  channels 
with  smaller  amounts  of  absorption  coming  from  C02  and  N20. 

The  line-by-line  program  included  the  effects  of  induced  emission, 
a  significant  factor  in  the  18-28  ym  region.  The  absorption  due 
to  the  water  vapor  continuum  was  not  included  in  the  transmission 
computations ; 

The  absorption  was  calculated  for  three  atmospheric  models8: 
a  mid-latitude  summer  model,  a  subarctic  winter  model,  and 
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TABLE  3.1.  CENTRAL  FREQUENCIES  AND  BANDWIDTHS  FOR  THE  SSH/2  SOUNDER. 
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©  Data  for  Operating  Temperature  of  25°C. 

0  Noise  Equivalent  Brightness  Temperature  for  a  Standard  Atmosphere 


FILTER  RESPONSE  FUNCTIONS^,  (v)  FOR  CHANNELS  7-14  OF  THE  SSH/2  SOUNDER 
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FREQUENCY  (CM 


a  tropical  model.  The  radiance,  r^,  measured  by  channel  i 
centered  at  frequency  v-[  is  given  by. 


Ps 


B_ .  (T  ) T .  (Ps)- 

VI  S  1 


B_  .  [T (p) ] 

V 1 


iM-  dlnp 


(1) 


3  lnp 


O 


where  p  is  pressure,  ps  the  surface  pressure,  Ts  the  surface 

skin  temperature,  x^(p)  the  channel  averaged  transmittance 

from  the  top  of  the  atmosphere  to  pressure  p  for  the  atmospheric 

model  in  question  and  B^  (T)  the  Planck  emission  function  at 

i 

frequency  v"i  and  temperature  T.  The  derivative  9xi/8lnp  gives 
the  relative  contribution  of  the  Planck  emission  at  each  level 
in  the  atmosphere  to  the  measured  radiance.  Figures  3.2  -  3.4  show 
the  weighting  function  3xi/31np  plotted  as  a  function  of  pres¬ 
sure  for  the  mid-latitude  summer,  sub-artic  winter  and  tropical 
models.  The  weighting  functions  are  distributed  throughout  the 
troposphere  with  channel  7  measuring  radiation  emitted  primarily 
from  the  surface  and  Channel  14  measuring  radiation  emitted  from 
above  400  mb.  Figure  3.5  shows  how  various  atmospheric  models 
affect  the  weighting  functions.  A  lower  tropospheric  channel  (8) 
and  an  upper  tropospheric  channel  (13)  were  plotted  for  the  three 
atmospheric  models  discussed  above.  Except  for  some  stratospheric 
levels  the  amount  of  water  vapor  increases  as  one  proceeds  from  the 
subarctic  winter  model  through  the  mid-latitude  summer  model  to 
the  tropical  model.  This  results  in  the  weighting  functions 
peaking  nearer  the  surface  for  the  drier  models  due  to  the 
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Figure  3.2.  Weighting  Functions  axj/ainp  for  Channels  7-14 
Of  The  SSH/2  -  Mid-Latitude  Summer  Profile 
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Figure  3.3.  (feinting  Functions,  3Tl/31np  for  Channels  7- 
or  The  SSH/2  -  Subarctic  Winter  Profile 
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Figure  3.4.  Weighting  Functions,  9Tj[/3lnp  for  Channels  7-14 
of  The  SSH/2  -  Tropical  Atmosphere 
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Figure  3.5.  Weighting  Functions,  9Ti/81np  for  Channels  8  and  13 
of  The  SSH/2  for  Three  Atmospheric  Models 
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decreased  absorption  by  water  vapor.  The  wetter  models  peak 
at  higher  levels. 

This  extreme  dependence  of  axj/ainp  upon  atmospheric  water 
vapor  distribution  results  in  a  variation  of  several  hundred 
millibars  in  level  of  peak  contribution.  This  is  quite  different 
from  temperature  sounding  channels  based  upon  absorption  due  to 
gases  of  fixed  mixing  ratio  (usually  CO2  for  the  infrared) 
where  changes  in  weighting  functions  are  a  secondary  effect. 


Let  the  integrated  water  vapor  amount  from  the  top  of  the 
atmosphere  to  pressure  p  to  be  defined  as 

U(p)  --J- 

with  g  the  acceleration  of  gravity  and  q(p)  the  mixing  ratio 
of  water  vapor  at  pressure  p.  Now  rewrite  the  radiative  transfer 
equation  (R.T.E.),  (1),  with  U(p)  as  the  vertical  coordinate 


q(p')  dp' 


(2) 


-U 


r . 
1 


-  Bvi<V*<V- 


B _ [T  (U)  1  ■  r)-— dlnU 

V1  31nU 


(3) 


where  Us  =  U (ps)  . 


Figures  3.6,  3.7  and  3.8  show  the  weighting  functions  plotted  in 
this  integrated  water  vapor  space  or  U-space .  These  U-space 
weighting  functions  are  much  less  sensitive  to  atmospheric 
changes  than  are  the  pressure-space  functions.  Because  of  the 
diversity  in  total  water  vapor  in  each  of  the  models,  the  lowest 
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Figure  3.6.  U-Space  Weighting  Functions,  3xi/3lnU  --  Mid-Latitude 
Summer  Profile 
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Figure  3.7.  U-Space  Weighting  Functions,  9Ti/8lnU  - 
Winter  Profile 
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Figure  3.8.  U-Space  Weighting  Functions,  3xi/3lnU  --  Tropical 
Profile 
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level  of  the  weighting  function  changes  by  an  order  of  magnitude, 
from  .5  cm  H2O  for  the  arctic  model  to  5  cm  for  the  tropical 
model . 

This  sensitivity  is  an  indication  that  the  temperature, 
pressure,  and  so-called  memory  effects  on  absorption  for 
these  bands  are  secondary  to  the  total  H2O  amount  in  the  path. 

For  channels  in  regions  with  absorption  dominated  by  constant 
(or  nearly  constant)  mixing  ratio  gases  the  functions  plotted 
in  pressure  space  and  integrated  absorber  space  are  identical. 

3.2  SENSITIVITY  CALCULATIONS 

Weighting  functions  indicate  which  levels  of  the  atmosphere 
contribute  most  to  the  measured  radiance.  However,  for  remote 
sensing  problems  one  is  interested  in  the  sensitivity  of  the 
measurement  to  changes  in  the  desired  parameter.  A  sensitivity 
that  exceeds  the  noise  level,  as  well  as  the  effects  of  other 
undesirable  and  uncorrectable  factors,  is  a  necessary,  but  not 
sufficient  condition  for  ultimately  retrieving  the  desired 
quantity  from  the  measurements. 

The  sensitivity  of  the  SSH/2  water  vapor  channels  was  studied  by 
dividing  the  atmosphere  into  layers  and  perturbing  separately  the 
values  of  temperature  and  water  vapor  amount  in  each  layer. 
Radiances  were  computed  for  each  channel  for  perturbation  at  all 
levels,  and  these  were  subtracted  from  the  radiances  of  the  unper¬ 
turbed  profile.  By  plotting  these  differences  as  a  function  of 
the  level  at  which  the  perturbation  was  applied,  one  can  see  the 
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relative  sensitivity  of  the  channels  throughout  the  atmosphere. 
Because  all  layers  of  our  model  atmosphere  are  not  of  a  uniform 
thickness,  the  radiance  differences  were  normalized  by  dividing 
by  the  thickness  of  the  layer  in  kilometers.  Because  the  amount 
of  water  vapor  varies  by  many  orders  of  magnitude  from  the  bottom 
of  the  atmosphere  to  the  tropopause,  the  water  vapor  was  perturbed 
by  an  amount  equal  to  80%  of  the  standard  value  at  each  layer. 

This  80%  increase  may  result  in  unphysical  profiles  in  the  sense 
that  relative  humidities  greater  than  100%  can  occur,  but  since 
the  physics  of  absorption  is  not  affected  by  relative  humidity, 
this  procedure  gives  a  reasonable  indication  of  the  sensitivity. 

The  sensitivity  to  water  vapor  amount  was  compared  with  the 
changes  in  observed  brightness  temperature  due  to  decreasing 
the  temperatue  in  each  layer  by  2°K.  The  80%  perturbation 
is  a  large  change  relative  to  the  desired  accuracy  of  10%, 
but  was  selected  due  to  the  narrow  1  km  layers  to  which 
these  changes  were  made. 

The  sensitivity  calculations  were  performed  using  a  rapid 
algorithm  for  transmi ttances  developed  in  an  internally  funded 
research  program.  The  details  of  the  algorithm  are  given  in 
Appendix  A. 

Because  of  the  non-linear  nature  of  the  problem  the  sensitivity 
is  dependent  on  the  base  or  unperturbed  profile  chosen.  Figure 
3.9  shows  the  response  to  an  80%  increase  in  layer  H2O  amount  for 
a  mid-latitude  summer  atmospheric  profile.  Increasing  the 
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Figure  3.9.  Sensitivity  to  an  80%  Increase 
Layer  Water  Vapor 


-1.5 


in  Atmospheric 


3-15 


amount  of  water  vapor  increases  the  absorption,  causing  the 
emission  to  come  from  higher  and  colder  (in  the  troposphere) 
levels.  Thus  an  increase  in  water  vapor  causes  a  decrease  in 
observed  brightness  temperature.  The  peak  of  sensitivity 
occurs  for  all  channels  between  700  and  300  mb  and  the  curves 
are  much  less  spread  out  than  the  weighting  function  curves. 

It  is  important  to  note  that  none  of  the  channels  have  significant 
sensitivity  near  the  surface;  this  occurs  despite  the  large  surface 
contribution  to  radiance  for  channels  7  and  8.  This  effect  will 
be  explained  further  in  the  next  section. 

Uncertainties  in  cloud  cover  and  temperature  also  contribute 
noise  that  tends  to  mask  changes  due  to  water  vapor  effects. 

Figure  3.10  shows  the  sensitivity  to  perturbation  by  2°K  of  the 
temperature  for  each  layer.  Although  the  peaks  of  these  sensi¬ 
tivity  curves  are  less  than  those  for  the  water  vapor  sensitivity 
they  are  spread  over  a  larger  range  of  the  atmosphere  and  some 
channels  peak  near  the  surface. 

3 .3  LACK  OF  UPPER  AND  LOWER  ATMOSPHERIC  SENSITIVITY 

Figures  3.11,  3.12,  and  3.13  show  the  temperature  and  H2O 
sensitivity  superposed  for  channels  8,  10  and  13  respectively. 
Channel  8  has  the  best  H2O  sensitivity  at  the  lowest  levels, 
but  even  for  this  channel,  below  850  mb,  the  H2O  sensitivity 
is  less  than  the  temperature  sensitivity.  The  other  channels 
show  a  greater  H20  sensitivity  compared  with  temperature,  but 
this  advantage  is  confined  to  levels  400-600  mb. 
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Figure  3.10.  Sensitivity  to  a  2°K  Decrease  in  Atmospheric 
Layer  Temperature 
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Figure  3.11.  Temperature  and  H20  Sensitivity  of  Channel  8 
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Figure  3.12.  Temperature  and  H2O  Sensitivity  of  Channel  10 
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Figure  3.13.  Temperature  and  H2O  Sensitivity  of  Channel  13 


Figures  3.14  and  3.15  show  the  effect  of  a  different  atmospheric 
base  profile  on  sensitivity.  The  temperature  and  water  vapor 
sensitivity  of  channel  10  was  plotted  for  both  the  mid-latitude 
summer  profile  used  above ,  and  a  tropical  profile.  The  temperature 
sensitivity  is  shifted  to  significantly  higher  levels  in  the 
tropical  case  but  the  effect  on  H2O  sensitivity  is  much  less. 

The  lack  of  sensitivity  near  the  surface  to  water  vapor  changes 
can  be  understood  by  rewriting  the  R.T.E.  using  integration  by 
parts  as, 


•B  _  (Ps) 
vi 


r .  = 

i 


B  -Vi^PtOT3) 


VP)  dB-±(p)  +  B-[T(Ptopn 


(4) 


and  discretizing  it  at  J  levels  with  level  J  the  surface 
and  level  1  at  P^Qp/ 


3B-. 

vx 


=  V  Ti(pi) 

1  1  3  3T 


3=2 


(T(P.)-T(P.  x)  +  B— ±  [T  (P  ^  )  ] 


T  (P.  ) 


Noting  that  the  transmittance,  Tj_(Pj)/  may  be  written, 


(5) 


w  =  TT  STi<Pk> 

k=i 


(6) 


where  6xi(Pk)  is  the  effective  transmittance  from  pk  to  pk_x, 
and  if  it  is  assumed  that  changes  in  water  vapor  amount  at  a 
given  layer  affect  only  the  transmittance  for  that  layer.  This 
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Figure  3.14.  H20  Sensitivity  of  Channel  10  to  Mid-Latitude 

Summer  and  Tropical  Profiles 
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Figure  3.15.  Temperature  Sensitivity  of  Channel  10  to  Mid- 
Latitude  Summer  and  Tropical  Profiles 
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approximation  is  a  good  one  if  the  layers  are  narrow  and  the 
perturbations  are  small.  Even  for  thick  layers,  effects  in  the 
layer  transmittance  at  lower  layers  are  smaller  than  the  change 
at  the  layer  perturbed. 


The  sensitivity  in  observed  radiance  to  a  change  in  water  vapor 
mixing  ratio  qk  in  the  layer  from  pk  to  pk_y  may  be  written. 


3r . 

l 

9qk 


J 

[In  (6t±  (Pk))]  •  Y.  Ti(pj) 
j  =  k 


3B— . 

VI 


[T(p.)-T(Pj_1)]  (7) 


The  first  term  on  the  right  hand  side  of  (7)  is  the  change  in 

effective  layer  optical  depth  for  channel  i  and  can  be  estimated 
from  the  rapid  algorithm. 


As  expected,  there  is  no  response  to  a  change  at  any  levels 
where  Tf(p)  =0.  Changes  near  the  surface  are  made  up  of 
few  terms  in  the  summation.  Each  term  is  weighted  by  the 
temperature  lapse  in  that  layer.  For  the  case  of  the  term 
nearest  to  the  surface  one  writes, 


3r. 

l 

9qT 


3q . 


[In  (<5x  .  (PT))]  .  x,  (PT) 


3B_. 

VI 

3T 


If  the  lowest  layer  is  isothermal  the  response  is  again  zero. 
Even  if  the  lapse  rate  is  not  zero  the  single  term  in  the 
summation  results  in  less  sensitivity  than  at  higher  layers 
which  contain  several  terms.  Thus,  it  can  be  seen  that  for 
infrared  sounders  sensitivity  to  water  vapor  will,  in  general. 


(8) 
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be  small  at  layers  near  the  ground.  The  behavior  exhibited  by 
the  SSH/2  is  a  property  of  all  passive  sounders  used  for 
constituent  retrievals  when  the  surface  emissivity,  e,  is  near  1. 

Such  is  the  case  for  the  entire  infrared  region  and  for 
microwave  observations  over  land.  In  microwave  observations 
over  water,  where  e  is  significantly  smaller  than  unity,  the 
sensitivity  is  greater,  but  other  problems  arise;  the 
emissivity  and  skin  temperature  must  be  determined  to  a  high 
accuracy . 
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SECTION  4.0 


OUTLINE  OF  STUDY  PLAN 

4.1  IMPLICATIONS  OF  SENSITIVITY  STUDY 

The  lack  of  sensitivity  of  any  of  the  SSH/2  channels  to  water 
vapor  in  the  lowest  layers  demonstrates  that  one  cannot  obtain 
direct  information  on  H2O  at  these  levels  from  the  SSH/2 
radiances  alone.  However,  other  information  is  available. 
Physically  we  know  that  the  relative  humidity  must  be  between 
0-100%.  (Actually  it  may  exceed  100%  slightly,  but  only  in 
regions  of  high  cloudiness  that  probably  preclude  retrievals 
anyway.)  Thus  if  we  can  obtain  the  corresponding  temperature 
profile  from  CC>2  channels  or  a  microwave  sounder  we  can  place 
some  limits  on  the  allowable  H2O  content.  Statistical 
information  obtained  from  in  situ  measurements  (e.g.,  the 
radiosonde  network)  allows  one  to  relate  the  water  vapor  in 
the  middle  troposphere,  where  direct  information  is  available, 
to  the  amounts  at  lower  layers.  Statistical  relationships 
can  also  be  derived  between  the  temperature,  where  again 
direct  information  is  available  even  at  lower  layers,  and  the 
H2O  content.  Thus  this  lack  of  lower  atmospheric  sensitivity 
does  not  preclude  retrieval  of  water  vapor  there;  it  only  makes 
it  more  difficult. 

Such  statistically  derived  profiles  have  the  potential  for 
improvement  by  a  physically  based  solution  of  the  R.T.E.,  but 
only  in  the  region  of  high  H2O  sensitivity  (850-400  Mb).  Our 
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approach  thus  consists  of  a  statistical  first  guess  improved  by 
a  non-linear  relaxation  technique. 

4.2  STATISTICAL  INVERSION 

One  of  the  most  straightforward  ways  to  use  this  additional 
information  in  obtaining  a  retrieval  is  to  use  a  statistical 
inversion  method.  Several  possible  methods  are: 

(a)  a  multiple  linear  regression  using  only  a  subset  of 
possible  channels  to  insure  inver tab ili ty  of  the 
covariance  matrix  (screening  regression) 

(b)  a  multiple  linear  regression  incorporating  external 
constraints  that  add  a  regularization  matrix  for 
stability  of  the  solution. 

(c)  a  regression  in  an  eigenspace 

Before  discussing  the  advantages  and  disadvantages  of  each  of 
these  methods,  some  features  common  to  all  will  be  described. 

These  linear  statistical  techniques  can  all  be  written  as, 

q  =  Ct  (9) 

where  q  is  a  vector  of  predictands,  C  is  a  matrix  derived 
for  each  technique,  t  is  a  vector  of  predictors.  The  predictors 
may  be  any  information  that  is  related  statistically  to  the 
quantity  we  desire.  For  example,  the  predictors  may  be 
observed  radiances  or  brightness  temperatures  of  water  vapor 
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channels,  radiances  or  brightness  temperatures  of  C02  channels, 
water  vapor  or  temperature  information  obtained  from  a  numerical 
weather  prediction  model,  or  cloudiness  information  obtained  from 
IR  window  and  visible  channels.  Any  combination  of  these  or  other 
parameters  is  possible.  The  stability  of  some  methods  limits  the 
predictors  that  may  be  used,  particularly  when  there  is  a  high 
degree  of  interdependence  between  them. 

For  each  method,  the  prediction  matrix  C  is  derived  by  using  a 
set  of  SSH/2  observations  that  coincides  with  a  set  of  radiosonde 
measurements.  The  radiosonde  measurements  are  considered 
exact.  Operationally,  only  infrequently  do  spacecraft  passes 
exactly  coincide  with  a  radiosonde  launch,  so  a  criteria  must  be 
set  that  determines  when  these  two  observations  are  collocated 
closely  enough  in  space  and  time  to  be  included  in  the 
statistics.  This  set  of  dependent  data  is  used  to  derive 
the  linear  prediction  matrix,  C. 

To  summarize,  some  of  the  common  features  of  the  three  statistical 
techniques  previously  discussed  are: 

(1)  all  methods  are  linear 

(2)  a  wide  range  of  predictors  and  predictands  is  possible 

(3)  they  require  ground  truth  statistics  to  derive  the 
solution  matrix 

A  straightforward  regression  procedure,  that  predicts  the  water 
vapor  at  each  level,  q£,  as  a  function  of  the  measured 
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brightness  temperatures  for  each  channel,  suffers  from  several 
drawbacks.  First,  if  all  channels  were  used  in  the  regression, 
the  large  degree  of  interdependence  between  them  would  result  in 
an  unstable  solution.  Elimination  of  several  channels  from  the 
predictors  in  the  regression  would  solve  the  instability  problem  -- 
at  the  expense  of  eliminating  the  small  amount  of  independent 
information  contained  in  the  rejected  channels.  Second,  the 
correlation  between  water  vapor  at  various  levels  limits  the 
number  of  independent  pieces  of  information  that  may  be  obtained 
from  the  data.  This  number  is  certainly  less  than  24,  the  number 
of  levels  used  in  our  calculations. 

The  eigenvalue-eigenvector  method  (EEM)  developed  by  Smith 
and  Woolf1  solves  both  these  problems.  It  enables  one  to  include 
all  channels  in  the  regression  procedure  without  instability 
and  noise  sensitivity  problems.  In  addition,  the  correlation 
of  water  vapor  amounts  between  layers  is  taken  into  account  in 
such  a  way  that  variations  not  justified  by  the  radiances 
measurements  are  not  introduced. 

The  regression  technique  employing  regularization  can  be  shown 
to  be  equivalent  to  the  EEM  technique1^.  The  Smith-Woolf 
technique  was  selected  because  with  it  the  instability  can  be 
seen  and  eliminated  more  easily  than  with  the  regularization 
technique . 
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4.3  NON-LINEAR  RELAXATION  CORRECTION 


The  deviation  of  a  level's  mixing  ratio,  q-j_,  from  its  statistical 
mean,  can  be  considered  a  function  of  the  deviation  of  the  eight 
channel  brightness  temperatures  (TB)  from  the  value  they  would 
have  for  the  statistical  mean  profile  (ATg) .  The  matrix  C  expresses 
each  qi  as  a  linear  function  of  the  eight  Tg  deviations,  ATg. 

Higher  order  terms  could,  of  course,  be  included.  That  is, 
each  value  of  q-^  could  be  expressed  as  the  statistical 
q^  plus  a  power  series  in  the  eight  ATg's.  The  C  matrix 
gives  the  coefficients  in  the  linear  terms;  quadratic, 
cubic,  and  higher  coefficients  might  also  be  generated. 

Such  a  scheme  would  have  the  limitation  of  any  power  series 
expansion:  it  would  be  inaccurate  for  large  arguments. 

Therefore  it  was  decided  to  make  the  "non-linear"  correction 
via  a  relaxation  process  .  This  involves  computing  a  new  set 
of  brightness  temperatures,  a  new  set  of  ATgS ,  with  presumably 
smaller  values,  and  from  these,  a  correction  to  the  first  guess 
in  q^ .  One  can  then  stop  or  make  as  many  repetitions  as 
necessary.  The  details  of  this  correction  method  are  in 
Section  6. 
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4.4  SIMULATION  TECHNIQUES 


As  real  observations  are  not  yet  available  from  the  SSH/2, 
it  is  necessary  to  simulate  a  set  of  collocated  observed 
brightness  temperatures  and  atmospheric  temperature  profiles 
and  moisture  profiles. 

A  set  of  1200  temperature  and  water  vapor  profiles  obtained 
from  NOAA/NESS-*-  was  used  to  derive  and  test  both  the  statistical 
first  guess  profiles  discussed  in  this  section,  and  the  relaxation 
algorithms.  The  profiles  are  divided  into  groups  of  400,  coming 
from  arctic,  tropical,  and  mid-latitude  regions. 

Radiances  and  brightness  temperatures  for  channels  7-14  of 
the  SSH/2  were  simulated  for  these  1200  profiles  using  the  rapid 
transmittance  algorithm.  The  combined  profiles  and  radiances 
were  then  available  to  derive  the  linear  prediction  matrices  C. 

For  this  purpose  the  three  climatological  sets  --  mid-latitude, 
arctic,  and  tropical  --  were  each  divided  into  groups  of  225 
dependent  profiles  to  derive  the  matrix  C,  and  75  independent 
profiles  to  test  its  accuracy.  The  remaining  100  profiles  in 
each  group  were  reserved  for  later  unbiased  tests  that  may  be 
desired.  The  means  and  standard  deviations  for  water  vapor  and 
temperature  for  the  mid-latitude,  arctic,  and  tropical  400 
profile  subsets  are  given  in  Tables  4.1  and  4.2.  all  radiative 
transfer  calculations  were  made  in  a  24  level  coordinate  system, 
the  twenty  levels  given  in  Tables  4.1  and  4.2,  plus  four  at  lower 
pressures  (1  mb,  10  mb,  50  mb,  and  100  mb).  These  four  levels  were 
included  to  accurately  account  for  the  small  absorbtion  due  to 
constant  mixing  ratio  gases. 
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Table  4.2  Temperature  Statistics  of  the  NOAA/NESS  Data  Set 
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In  this  study  only  H2O  channel  brightness  temperatures  and 
tropospheric  temperatures  were  used.  Brightness  temperatures 
are  preferred  in  general  to  radiances  because  fewer  scaling 
problems  arise.  Actual  level  temperatures,  as  opposed  to  C02 
brightness  temperatures,  were  used  because  they  do  not  require 
a  rapid  algorithm  to  calculate  transmi ttances  and  radiances. 


4-9 


SECTION  5.0 


STATISTICAL  FIRST  GUESS 


5.1  SMITH -WOOLF  TECHNIQUE 


The  notation  used  for  the  first  guess  procedure  is; 


n  number  of  predictors  (#  of  channels  plus  #  of  temperatures) 
r  number  of  predictands  (#  of  levels) 

s  number  of  dependent  data  samples 

m  number  of  eigenvectors  selected  for  the  predictands 

(m  <  r) 

q  number  of  eigenvectors  selected  for  predictors  (q  £  n) 

U  matrix  of  predictands,  columns  are  H2O  profiles  for 

s  samples  (r  x  s) 

T  matrix  of  predictors,  columns  are  brightness  temperatures 
and  atmospheric  temperatures  (n  x  s) 

U*  eigenvectors  of  UUfc  (r  x  r) 

0*  selected  subset  of  first  m  eigenvectors  of  U*  (r  x  m) 

A  diagonal  matrix  whose  elements  are  eigenvalues  corresponding 
to  columns  of  U*  arranged  in  decreasing  magnitude  (r  x  r) 

A*  First  m  eigenvalues  of  A  (m  x  m) 
eigenvectors  of  TTfc  (n  x  n) 

selected  subset  of  first  q  eigenvectors  of  T  (q  x  n) 

A^  same  as  A  corresponding  to  T*  (n  x  n) 

At*  same  as  A*  corresponding  to  T*  (q  x  q) 

C  linear  prediction  matrix 


T* 


T* 


The  matrices  U*,  A,  T*,  At  satisfy,  (UUfc)  =  U*AU*b,  U*fcU  =  I 
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and 


(TTt)  =  I,  where  the  superscript  t 


denotes  a  transpose  and  I  is  the  identity  matrix. 

By  truncating  U*,  A*  and  T*,  A*,  to  the  largest 
m  and  q  eigenvalues  respectively,  the  matrix  C  may  be  written, 

C  =  (1/s) (U*  U*fc)  (UTfc) (T*  At"1  T*fc)  (10) 

It  can  be  shown  that  if  we  use  all  the  eigenvectors  (i.e. 
m  =  T,  q  =  n)  that  (10)  reduces  to  the  ordinary  least  squares 
solution 

C  =  U  Tfc  (T  Tfc ) -1  (11) 

Given  a  vector  of  observations,  £,  a  first  guess  profile,  q 
is  obtained  from, 

a  _  A 

q  =  c  t  d2) 

The  sensitivity  of  the  ordinary  least  squares  solution  to 
errors  is  given  by  the  condition  number  K.  This  is  given  by 

K  =  Xi/ln  where  Xj,  i  =  l...n 

are  the  diagonal  elements  (eigenvalues)  of  At-  Since 

the  weighting  functions  of  the  SSH/2  are  highly  overlapping,  the 

covariance  matrix  TTfc  is  usually  singular  or  near  singular. 
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This  results  in  Xj_  that  rapidly  approach  zero  as  i  increases  and 
Xi>>  Xn.  Hence  the  condition  number,  K,  is  quite  large. 

A  large  K  means  that  small  errors  in  the  observed  quantity  t  are 
mapped  into  large  errors  in  the  retrieved  quantity  q,  resulting  in 
solutions  highly  sensitive  to  noised-*-.  It  should  be  noted  that  due 
to  round  off  effects  in  the  computer,  some  degree  of  noise  is  always 
present,  even  for  simulated  radiances  with  no  explicity  added  errors. 

Now  the  advantage  of  the  Smith-Woolf  method  can  be  seen:  by 
truncating  the  sequence  of  eigenvalues,  one  reduces  the  condition 
number,  and  hence  the  sensitivity  to  noise. 

5 . 2  FIRST  GUESS  PROGRAM  IMPLEMENTATION 

A  program  was  written  to  implement  the  Smith-Woolf  technique 

and  test  it  using  the  set  of  profiles  and  corresponding  brightness 

temperatures.  The  procedure  is: 

•  Read  parameters  to  control  the  run 

•  Compute  covariance  and  cross  covariance  matrices  for 
selected  set  of  dependent  profiles 

•  Compute  eigenvectors  and  eigenvalues 

•  Select  q  and  m  (the  number  of  eigenvectors  of  UUfc 
and  TTfc  respectively) 

•  Compute  C  matrix 

•  Loop  for  each  profile  in  independent  set 

•  Calculate  q  =  Ct 

•  Correct  so  relative  humidity  is  in  range  0-100% 

•  Calculate  errors  and  update  statistics  on  errors 
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•  End  Loop 

•  Print  out  summary  of  results  and  errors 

•  End  Program 


The  first  guess 
•  PREDICTORS 


•  PREDICTANDS 


•  NOISE 


•  DESATURATION 


•  NUMBER  OF 
EIGENVALUES 


program  has  the  following  features: 

SSH/2  brightness  temperatures  and 
atmospheric  level  temperatures  may 
be  used  in  any  combination 
Water  vapor  was  predicted  in  units 
of  mixing  ratios,  integrated  layer 
amount,  and  total  amount  from  the  top 
of  the  atmosphere  to  a  given  level. 
Gaussian  noise  may  be  added  to 
observed  brightness  temperatures 
and  or  level  temperature  estimates. 
Retrieved  profiles  may  be  adjusted 
so  relative  humidity  is  within  a 
given  range  for  any  level. 

One  or  several  combination  of  U 
and  T  eigenvalues  may  be  tested. 


The  choice  of  predictors  is  given  in  Table  5.1.  Any  combination  of 
these  quantities  can  be  tested.  In  addition  a  test  was  made  by 
averaging  the  tropospheric  temperatures. 

Table  5.2  is  a  list  of  the  fractional  variance  explained  by  the  first 
eight  eigenvectors  of  mixing  ratio  and  brightness  temperature,  given 
for  the  dependent  subsets  of  mid-latitude,  artic,  and  tropical 
profiles . 
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TABLE  5.1  Available  Predictors  for  the  Smith-Woolf  First  Guess  Procedure 


PREDICTOR  NUMBER 

(  CHANNEL  )  PREDICTOR 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 


TEMPERATURE  AT 


SSH/2  CHANNEL 


300  mb 
500  mb 
620  mb 
700  mb 
920  mb 
1000  mb 

\ 

f  1 
8 
9 

10 

< 

I  11 
12 

13 

14 
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TABLE  5.2  PERCENTAGE  VARIANCE  EXPLAINED  FOR  THE  FIRST  EIGHT 
EIGENVECTORS  OF  WATER  VAPOR  AND  BRIGHTNESS  TEMPERATURES 


Eigenvectors  of  24  Predictands  (H20  Levels) 


Eigenvector 

Number 

Mid-Latitude 

%  of  Variance 
Explained 

Arctic 

%  of  Variance 
Explained 

Tropical 

%  of  Variance 
Explained 

(1) 

(2) 

0) 

(2) 

0) 

(2) 

1 

87.83 

87.83 

93.35 

93.35 

83.66 

83.66 

2 

9.42 

97.25 

5.30 

98.65 

11.42 

95.08 

3 

1.92 

99.17 

0.93 

99.58 

3.39 

98.47 

4 

0.71 

99.88 

0.37 

99.95 

1.40 

99.87 

5 

0.07 

99.99 

0.02 

99.98 

0.11 

99.98 

6 

0.04 

100.00 

0.02 

100.00 

0.01 

99.99 

7 

0.00 

100.00 

0.00 

100.00 

0.01 

100.00 

8 

0.00 

100.00 

0.00 

100.00 

0.00 

100.00 

Ei genvectors 

of  14  Predictors 

Mid-Latitude 

Arctic 

Tropical 

Eigenvector 

Number 

%  of  Variance 
Explained 

%  of  Variance 
Explained 

%  of  Variance 
Explained 

0) 

(2) 

0) 

(2) 

(1) 

(2) 

1 

88.31 

88.31 

88.11 

88.11 

59.04 

59.04 

2 

5.44 

93.75 

5.49 

93.60 

25.95 

84.99 

3 

3.81 

97.56 

3.34 

96.94 

5.54 

90.53 

4 

1.19 

98.75 

1 .70 

98.65 

3.74 

94.27 

5 

0.44 

99.19 

0.69 

99.34 

2.29 

96.55 

6 

0.41 

99.59 

0.32 

99.65 

1.49 

98.04 

7 

0.22 

99.81 

0.19 

99.85 

1.05 

99.09 

8 

0.09 

99.91 

0.09 

99.94 

0.70 

99.76 

(1)  is  the  variance  explained  for  each  eigenvector 

(2)  is  the  cumulative  variance  explained  for  eigenvector  up  to  current  one 
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5.3  EVALUATION  OF  FIRST  GUESS  RESULTS 


The  accuracy  of  the  first  guess  algorithm  was  judged  by 

considering  several  factors: 

(1)  the  root  mean  square  error  of  water  vapor  at  each  level  as 
a  fraction  of  the  mean  of  the  dependent  profiles  (RMS) 

at  that  level. 

(2)  the  mean  square  error  at  each  level  as  a  fraction 
of  the  variance  at  that  level  of  the  dependent 
profiles  (fractional  unexplained  variance,  FUV) . 

(3)  the  RMS  error  of  the  total  integrated  water  vapor 
from  the  surface  to  the  top  of  the  atmosphere 
derived  from  the  predicted  profile. 

(4)  the  FUV  of  the  total  integrated  water  vapor  derived 
from  the  predicted  profile. 


The  RMS  error  is  mathematically  defined  as: 


RMS  (q)  = 


(q±-q 


•■1 


(13) 


where  the  sum  is  over  the  N  independent  profiles,  q^  is  the 
predicted  quantity  for  observation  i,  q-[  is  the  exact  quantity, 
and  q  is  the  mean  of  q  over  the  dependent  set  of  profiles. 

The  FUV  is  defined  as: 


FUV (q) 


N 

E 

i=i 


/ 


var  (q) 


(14) 


where  var(q)  is  the  variance  of  the  dependent  profiles. 
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Statistically  FUV  is  a  more  meaningful  measure  of  the  performance 
of  the  first  guess  procedure  because  it  tells  us  how  much  we  were 
able  to  reduce  the  natural  variations  of  the  atmosphere.  For 
FUV  =  0  one  has  a  perfect  set  of  retrievals.  A  FUV  =  1 

means  a  worthless  set  of  retrievals  in  the  sense  that  one  would 
do  just  as  well  by  using  the  climatological  mean. 

5.4  FIRST  GUESS  PROGRAM  RESULTS 

The  statistical  first  guess  procedure  was  evaluated  by  running 
controlled  tests  to  determine  optimal  settings  for  the  various 
options  of  the  program.  These  tests  selected  a  basic  control 
run  from  which  one  factor  was  changed  and  the  effects  on  the 
resultant  errors  were  then  compared. 

The  following  factors  were  investigated: 

(1)  optimal  units  for  predictands 

(2)  the  optimal  predictors 

(3)  the  effects  of  random  noise  added  to  the  predictors 

(4)  the  behavior  for  the  three  climatological  subsets: 
mid-latitude,  arctic,  and  tropical. 

The  control  run  that  was  held  fixed  for  all  four  tests,  was 
selected  with  the  following  parameters: 

•  water  vapor  was  predicted  in  units  of  mixing  ratio 

•  temperatures  at  all  six  levels  in  Table  5.1  and  the  8 
SSH/2  water  vapor  channels  were  used  as  predictors 
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•  gaussian  noise  of  1°C  was  added  to  the  temperature 
predictors  and  the  brightness  temperature  noise  level 
was  set  by  the  SSH/2  noise  specifications  in  Table  3.1 
(this  is  referred  to  as  the  low  noise  case) 

•  mid  latitude  profiles  were  selected 

Tables  5. 3-5. 6  give  the  results  for  four  tests. 

Table  5.3  shows  the  effects  of  varying  the  units  of  the  predictand. 
The  integrated  water  vapor  amount  to  a  given  pressure,  U(p), 
gives  significantly  better  results  at  most  levels.  This  is  due 
to  the  cancellation  of  errors  of  different  signs,  an  effect  that 
is  not  present  when  only  level  (q)  or  layer  (AU)  water  vapor  is 
predicted.  A  better  indication  of  the  overall  accuracy  is 
given  by  Us,  the  total  precipitable  water  vapor  to  the  surface. 

This  is  the  same  as  U(1000  mb).  Mixing  ratio,  q,  did  somewhat 
better  than  integrated  water  vapor,  U,  and  layer  water  vapor,  AU. 
However,  these  differences  are  probably  not  significant.  Tests 
run  with  several  sequences  of  random  noise  generated  from  different 
seeds,  but  with  the  same  statistical  properties  (standard  deviation 
and  bias)  ,  indicate  that  variations  in  FUV  of  0.02  to  0.04  can  be 
due  to  random  fluxuations. 

Table  5.4  shows  the  effects  of  using  various  predictors  to  predict 
mixing  ratio.  The  use  of  temperature  values  alone  does  signifi¬ 
cantly  worse  than  using  temperature  information  and  the  H2O 
brightness  temperatures.  Using  the  H2O  channels  alone  gives 
poor  results,  particularly  at  upper  levels.  This  result  is 
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Table  5.  5  Eff 
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somewhat  surprising  as  we  expect  that  the  lack  of  temperature 
information  would  show  up  most  notably  near  the  surface  where 
the  H20  channels  lack  sensitivity.  The  reason  may  be  that 
channels  7  and  8  give  a  good  indication  of  the  temperature  at 
the  lowest  atmospheric  levels,  whereas  the  lack  of  temperature 
information  in  the  upper  and  middle  troposphere  is  more 
sigificant . 

The  effect  of  different  noise  levels  is  given  in  Table  5.5. 
Remembering  that  differences  of  about  .02  in  FUV  are  not 
significant  we  can  see  that  noise  becomes  a  significant  effect 
only  at  the  highest  levels  of  1.5°K  temperature  and  1°K  in 
H20  channel  brightness  temperatures.  This  is  not  surprising 
since  the  EOF  regression  technique  is  relatively  insensitive 
to  noisy  measurements,  as  long  as  the  dependent  data  used  to 
generate  the  matrix  C  also  contains  the  same  noise  levels  as  the 
independent  set  used  to  verify  the  accuracy. 

In  Table  5.6  the  three  climatological  subsets,  mid-latitude 
arctic,  and  tropical  were  investigated.  Because  of 
differing  means  and  variances  it  is  difficult  to  compare 
the  accuracy  of  the  three  sets.  The  best  overall  behavior 
in  terms  of  FUV  was  obtained  by  the  midlatitude  profiles 
which  had  FUV tb:  .3  or  better  up  to  400  mb.  Arctic  profiles  gave 
good  accuracies  below  700  mb  but  had  an  anamolously  bad  region 
around  500  mb.  This  may  be  due  to  the  rapid  decrease  of  H20  with 
altitude  around  threse  levels.  Tropical  profiles  had  moderately 
poor  results  near  the  surface  with  very  good  results  (FUV;^  .2) 
from  about  500-850  mb. 
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SECTION  6.0 


PHYSICALLY  BASED  RETRIEVALS 


6.1  INTRODUCTION 

One  characteristic  of  statistical  techniques,  such  as  the  Smith- 
Woolf  method,  is  that  there  is  no  constraint  that  the  predicted 
profile  corresponds  with  the  observed  radiances,  even  within  the 
noise  limits  of  the  system.  The  possibility  arises  that  statist¬ 
ically  derived  retrievals  of  water  vapor  may  be  improved  by 
correcting  them  to  reduce  the  differences  between  observed 
radiances  and  those  predicted  from  the  profiles  using  the  R.T.E. 
Such  a  task  is  likely  to  be  a  delicate  one  because  of  the  limited 
sensitivity  of  the  H2O  channels  of  the  SSH/2 .  One  must  be  sure 
that  the  corrections  do  not  increase  the  error,  particularly  in 
regions  of  low  sensitivity  where  noise  is  likely  to  have  a  large 
e  f feet . 

Such  a  physically  based  approach,  involving  solving  the  radiative 
transfer  equation,  has  been  investigated  by  Chahine^,  and  Smith 
and  Howell^  among  others.  Unlike  statistical  procedures,  physical 
retrievals  require  that  the  transmissive  and  radiative  properties 
of  the  atmosphere  be  known  for  the  instrument  channels. 
Operationally,  this  requires  careful  calibration  utilizing  ground 
truth  data.  Computational  requirements  are  generally  greater 
than  for  linear  statistical  procedures. 
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Two  such  physically  based  retrievals  using  a  non-linear  relaxation 
technique  were  investigated.  The  basic  procedure  for  both  techniques 
consists  of  the  following  steps: 

(1)  Given  a  set  of  observed  brightness  temperatures  Tg, 

(2)  Set  n  =  o  and  obtain  a  first  guess  profile  qn(p)  from 
the  statistical  technique. 

(3)  Compute  the  brightness  temperatures  Tg  ,  corresponding 
to  the  profile,  qn(p). 

(4)  If  I  I  Tg^  -  Tg  I  I  <  e,  where  the  norm  is  taken 
over  all  channels,  then  exit  (solution  is  qn  (p) ) . 

(Have  our  residuals  converged  to  within  the  preselected 
tolerance,  e?) 

(5)  Compute  qn+1(p)  =  f(qn(p),  ATg  ). 

i 

n  =  n  +  1  (Updated  the  profile  based  upon  the  previous 
iteration  and  the  computed  residuals) 

(6)  Go  to  Step  3 

In  addition,  one  must  add  checks  to  insure  that  the  results  in 
terms  of  residuals  of  Tg  do  not  diverge,  and  that  one  does  not 
continue  to  iterate  indefinitely  when  neither  converging  nor 
diverging . 
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The  basis  of  each  technique  lies  in  the  way  that  the  correction 
(Step  5.)  is  applied. 

The  first  method  that  we  tested  uses  the  approach  of  Chahine, 
by  correcting  the  water  vapor  amount  at  selected  pressure  levels 
and  then  interpolating  and  extrapolating  to  the  remaining  levels. 

The  second  approach  applies  the  corrections  directly  to  the 
coefficients  multiplying  the  eigenvectors  obtained  from  the 
first  guess  procedure.  These  techniques  and  the  results  are 
discussed  in  the  following  sections. 

6.2  THE  FIXED  LEVEL  CORRECTION  METHOD 


In  this  technique,  we  followed  the  approach  of  Chahine  for  tempera¬ 
tures  and  constituent  retrievals.  Seven  tropospheric  pressure 
levels  were  selected  at  which  to  apply  corrections.  These  levels 
are  listed  in  Table  6.1.  In  order  to  reduce  the  effects  of  noise, 
the  corrections  at  each  of  these  levels  was  based  on  the  weighted 
sum  of  the  residuals  for  three  channels.  Layer  water  vapor  amount 
q^  was  updated  as  follows: 


where , 


14 


n  _  n-i  <r” 

qj  =  gj  +  Yj  I 


W.,  F  . .  At 
Dk  }kbv 

k=7  k 


jk  = 


STr  / 9q ■ 
Bk  D 


24  r- 3T 

I 

j=i 


'B, 


3q_ 


(15) 
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TABLE  6.1  FIXED  LEVEL  RELAXATION  WEIGHTS 


LEVEL 

(j) 

P. 

J 

(MB) 

CHANNEL 

NUMBER 

7 

8 

9 

10 

11 

12 

13 

14 

8 

200 

0 

0 

0 

0 

0 

1/3 

1/3 

1/3 

10 

300 

0 

0 

0 

0 

0 

1/3 

1/3 

1/3 

12 

400 

0 

0 

0 

0 

1/3 

1/3 

1/3 

0 

14 

475 

0 
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Because  of  the  non-linear  nature  of  the  problem,  if  one  makes  too 
large  a  correction,  the  updated  value  of  q  may  be  so  far  from  the 
true  value  that  subsequent  iterations  might  not  approach  the  true 
solution.  In  general,  one  wishes  to  damp  the  correction.  However, 
if  one  chooses  y  too  small,  the  solution  may  converge  but  very 
slowly.  Tests  indicated  that  y  =  1/3  provided  a  good  balance 
between  stable  behavior  and  rapid  convergence,  for  most  cases. 

The  W.,  were  chosen  by  giving  a  weight  of  1/3  to  the  three 
channels  with  weighting  functions  peaking  nearest  the  level  p^. 
Table  6.1  gives  the  weights  for  each  level. 

The  term  F-,  gives  the  sensitivity  of  changes  in  brightness 
J  K 

temperature  at  that  level  relative  to  the  total  sensitivity  at  all 
levels.  The  derivatives  were  estimated  from  the  rapid  algorithm 
(see  Appendix  A)  and  recomputed  for  each  step. 

Once  the  water  vapor  amounts  at  these  seven  layers  were  updated,  it 
was  necessary  to  construct  an  entire  profile  from  them.  The  final 
procedure  adopted  was: 

1.  Leave  lOOOmb  unchanged  from  the  first  guess. 

2.  Linearly  interpolate  between  200mb  and  1000  mb 

3.  Preserve  the  shape  of  the  first  guess  profile  for  levels 
above  200mb  by  making  adjustments  to  these  levels  pro¬ 
portional  to  the  adjustment  made  at  200mb . 
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Accuracy  was  seldom  improved  by  iterating  after  the  residuals 
decreased  to  or  below  the  noise  level.  Therefore,  the  trial  value 
of  the  profile  becomes  the  final  answer,  and  the  relaxation  stops, 
when: 


1.  The  residuals  in  six  of  the  eight  sounding  channels 
are  below  1  1/2  times  the  standard  deviations  of  the 
noise  in  those  channels; 

or  when: 

2.  The  median  (fourth  highest)  residual  is  3/4  the  standard 
deviation  of  the  noise  in  that  channel. 

The  exact  form  of  this  test  follows  from  trial  and  error  rather 
than  any  philosphical  considerations.  A  random  noise  generator 
that  outputs  noise  for  eight  channels  will  likely  compute  one  or 
two  very  noisy  radiances.  So  the  routine  stops  when  most  residuals 
are  below  tolerance,  assuming  that  those  remaining  out  of  tolerance 
are  the  very  noisy  ones  and  should  therefore  be  ignored. 

On  any  iteration  the  algorithm  tests  to  see  whether  the  residuals 
have  increased  or  decreased.  As  with  the  tolerance  test,  some 
provision  must  be  made  for  one  or  two  noisy  channels. 

Specifically,  the  trial  solution  is  assumed  to  be  converging  if: 

1.  the  residuals  have  decreased  for  six  of  the  eight 
channels  ;  and 


2. 


the  sum  of  all  the  residual's  absolute  values  has 


decreased . 

If  neither  of  the  above  tests  is  met,  the  next  iteration  is 
rejected  and  the  last  trial  solution  is  output  as  the  final 
answer . 

Another  feature  incorporated  into  the  relaxation  algorithms  is 
a  relative  humidity  correction.  After  each  iteration,  the 
water  vapor  at  each  level  was  adjusted  to  keep  the  relative 
humidity  between  0-100%. 

6.3  RELAXATION  IN  THE  SPACE  OF  EPF's 

Any  profile  in  the  1200  profile  set  (and,  presumably,  nearly 
any  observed  profile)  can  be  represented  to  a  high  accuracy  as 
a  linear  combination  of  a  seasonal  average  plus  a  few  EOF's. 
This  suggests  that  a  good  way  to  improve  on  the  First  Guess 
Algorithm,  which  calculates  the  expansion  coefficients  of  the 
EOF's  by  expressing  them  as  a  linear  combination  of  the 
observed  brightness  temperatures,  would  be  to  relax  in  the 
space  of  these  expansion  coefficients.  This  procedure  removes 
the  need  for  the  interpolation  and  extrapolation  of  the  fixed 
level  method. 
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The  basic  approach  in  this  technique  is  to  relax  in  the  space  of 
expansion  coefficients  used  in  expressing  the  trial  solution. 

Let  a  first  guess  profile  be  expressed  as  the  sum  of  N  EOF's, 


q°  (Pj) 


I 


a  -i 


o  * 
a£q£ 


<V 


(16) 


where 


q*  (P-j) 

J l  3 


is 


the  SL ' th  eigenfunction  at  Pj ^ 


The  coefficients  a*"1  are  then  generated  from  the  previous 

AJ 

iteration  for  channel  k  as  follows 


n 


a 

£ 


n-i 

a 

£ 


+  V3tb 


(3T  /3a  ) 2 

Bk  1 


The  derivatives  3TBk/3a^  are  estimated  from  the  rapid 
algorithm . 


(17) 


The  weights  are  selected  for  each  EOF  to  insure  stability. 

We  know  from  our  sample  profiles  that  the  first  EOF  explains 
most  of  the  variance,  with  rapidly  diminishing  amounts  explained 
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by  succeeding  EOF's.  This  means,  on  average,  that  the  expansion 
coefficients  decrease  in  magnitude  as  £  increases.  To  prevent 
the  higher  order  coefficients  from  growing  too  rapidly  one 
chooses  successively  smaller  Y^'3  as  &  increases.  This 
behavior  was  obtained  by  choosing  =  (l/B)5'.  B  =  3.5 
was  selected  after  running  several  tests. 

The  small  number  of  parameters  adjusted  suggests  an  alternative 
use  of  the  divergence  test.  We  compute  a  provisional  correction 
in  the  three  expansion  coefficients  based  on  only  one  channel's 

A 

residual.  Call  this  residual  (TBn  -  TBn) .  Then  the  divergence 
test  will  tell  us  whether  this  provisional  correction  should  be 
adopted.  If  so,  we  make  the  correction  and  apply  the  tolerance 
test;  if  not,  we  leave  the  profile  unchanged.  In  either  case 
(if  the  tolerance  test  is  not  met)  we  go  on  to  another  channel 
and  compute  another  correction.  This  scheme  is  incorporated 
into  the  final  form  of  the  program  shown  schematically  in 
Figure  6.1. 

The  convergence  test  and  the  relative  humidity  correction  remain 
the  same  as  for  the  fixed  level  correction  scheme. 
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Input  First  Guess  Mixing  Ratio  Profile  and  Measured  Brightness 
Temperatures,  (q^  and  Tg) 


Integrate  to  layer  amounts 

Use  orthogonality  to  find 

coefficients  in  EOF  expansion 

e.  +  Z  Mi 

Use  Rapid  Transmittance  Algorithm  to  find  T  values  and  compute 

residuals. 

EOF 


Update  profile  using 
designated  channel. 

- [z~zz: 


Chahine 


Update  profile  by  cor- 
recting  selected  levels, 


T 


Compute  new  brightness  temperatures  and  residuals. 


Chahine 


Iteration  number  N-»  N+l 


Chahine 


Re store  previous  trial 
profile;  select  new 
channel  for  corrections 


yes 


Compute  and  Output 
Final  Mixing  Ratio 
Profile 


Figure  6.1  Flow  Chart  of  the  Non-linear  Relaxation  Algorithm 
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6.4  RELAXATION  ALGORITHM  RESULTS 


The  three  climatological  sets  of  mid-latitude,  arctic,  and 
tropical  profiles  were  then  tested  with  the  two  relaxation 
algorithms  described  above.  The  noised  corrupted  radiances  were 
obtained,  and  the  statistical  first  guess  profile  was  passed  to 
one  of  the  two  relaxation  procedures.  The  relaxation  algorithms 
then  corrected  the  first  guess  moisture  profiles,  and  the 
accuracies  were  computed.  These  were  compared  with  the  accuracy 
of  the  first  guess  itself.  Figures  6.2  to  6.5  shows  the  results 
of  the  relaxation  procedures. 

Figure  6.2  gives  the  improvement  for  the  mid-latitude  set  of 
profiles  for  the  case  of  1°K  temperature  noise  and  the  SSH/2 
instrument  noise  given  in  Table  3.1  (the  instrument  noise 
case).  The  Figures  6.3,  6.4  and  6.5  give  results  for  the  higher 
noise  levels  of  1.5°K  temperature,  and  1°K  ^0  channel  noise 
(the  atmospheric  noise  case) .  The  plots  are  of  fractional 
unexplained  variance  as  a  function  of  altitude.  The  solid  line 
gives  the  first  guess  algorithm  alone,  the  dashed  line  the  EOF 
Relaxation  scheme,  and  the  unconnected  circles  the  fixed  level 
correction  scheme. 

When  the  EOF  method  was  used,  an  expansion  truncated  at  three 
EOF's  gave  the  best  results  for  mid-latitude  and  arctic  profiles. 
The  tropical  profiles  required  four  EOF's,  however. 


6-11 


FRACTIONAL  UNEXPLAINED  VARIANCE 


FOR 


FIG.  6.2  COMBINED  FIRST  GUESS  AND 
SIMULATED  MIDLATITUDE  PROFILES  WITH 


RELAXATION  RESULTS 
ADDED  INSTRUMENT  NOISE 
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FRACTIONAL  UNEXPLAINED  VARIANCE 


FIG.  6.3  COMBINED  FIRST  GUESS  AND  RELAXATION  RESULTS 
FOR  SIMULATED  MIDLATITUDE  PROFILES  WITH  ADDED  ATMOSPHERIC  NOISE 
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FIG.  6.4  COMBINED  FIRST  GUESS  AND  RELAXATION  RESULTS 
FOR  SIMULATED  ARCTIC  PROFILES  WITH  ADDED  ATMOSPHERIC  NOISE 
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FIG.  6.5  COMBINED  FIRST  GUESS  AND  RELAXATION  RESULTS 
FOR  SIMULATED  TROPICAL  PROFILES  WITH  ADDED  ATMOSPHERIC  NOISE 
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Both  relaxation  algorithms  give  small  but  significant  improve¬ 
ments  for  the  mid-latitude  set  at  both  levels  of  noise  from 
400-700  mb.  The  surface  levels  showed  no  change.  Levels  above 
300  mb  indicated  some  decrease  in  accuracy  but  the  first  guess 
only  results  in  this  region  were  poor  also.  Such  behavior  is 
expected  by  the  sensitivity  study  which  indicated  that  only 
middle  tropospheric  improvements  can  be  expected. 

Figure  6.4  showed  improvement  at  most  tropospheric  levels  for  an 
arctic  atmosphere.  Results  were  even  improved  at  500  mb  where 
the  first  guess  procedure  yielded  anomalously  bad  results. 

Figure  6.5  gives  tropical  results.  No  improvement  was  obtained 
below  600  mb.  The  results  from  300-600  mb  were  significantly 
improved.  This  upward  shift  is  not  unexpected,  because  the 
larger  H20  amounts  in  this  set  shifts  the  sensitivity  of  the 
SSH/2  to  higher  levels. 

For  the  most  part  the  two  relaxation  techniques  yielded  the  same 
overall  accuracy.  The  EOF  scheme  tended  to  be  more  stable 
particularly  at  higher  levels,  where  it  seldom  degraded  the 
results  above  300  mb  significantly,  something  the  fixed  level 
scheme  often  did.  This  is  not  surprising  because  the  EOF  scheme 
constrained  the  results  to  be  in  the  space  spanned  by  the  first  3 
or  4  eigenvectors.  The  magnitude  of  these  vectors  is,  in 
general,  quite  small  at  the  upper  levels.  Corrections,  which 
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include  ones 
small  at  the 
need  for  the 
method.  For 


that  improve  as  well  as  degrade  the  results,  were 
higher  levels.  The  EOF  scheme  also  eliminates  the 
complicated  interpolations  used  in  the  fixed  level 
these  reasons  the  EOF  technique  is  to  be  preferred. 


6-17 


SECTION  7.0 


CONCLUSIONS 

The  water  vapor  channels  of  the  DMSP  SSH/2  sounder  have  been 
analyzed  and  their  sensitivity  to  water  vapor  changes 
throughout  the  troposphere  have  been  estimated.  The  eight 
H2O  channels  measure  radiation  emitted  throughout  the 
troposphere  from  the  surface  to  ~300  rob  with  a  high  degree 
of  overlap.  Their  sensitivity  to  changes  in  water  vapor 
content  is  concentrated  over  a  much  smaller  region  (for  a 
mid-latitude  profile  the  peaks  in  sensitivity  range  from 
600-400  mb).  The  sensitivity  approaches  zero  near  the  surface. 

This  lack  of  surface  sensitivity  was  shown  to  be  a  property 
of  all  infrared  passive  thermal  emission  remote  measurements  of 
constituent  content,  not  just  of  the  SSH/2.  From  this  analysis 
it  is  seen  that  the  standard  weighting  functions  d-u/dlnp 
are  not  the  appropriate  means  to  evaluate  water  vapor  sounding 
instruments,  but  rather  sensitivity  curves. 

This  lack  of  sensitivity  by  the  SSH/2  water  vapor  channels,  and 
indeed  of  all  passive  IR  water  vapor  sounders,  places  severe 
limits  on  the  direct  information  available  on  water  vapor  near 
the  surface,  as  well  as  total  precipitable  water.  This  does  not 
preclude  indirectly  obtaining  water  vapor  profiles  down  to 
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the  surface  using  statistical  relationships.  Such  statistical 
relationships  rely  on  the  inherent  correlations  between  temper¬ 
ature  and  water  vapor  amounts  at  a  given  level,  and  the 
correlation  between  water  vapor  at  upper  tropospheric  levels 
(where  direct  information  is  available)  and  the  near  surface 
layers . 

The  regression  technique  developed  by  Smith  and  Woolf  was 
selected  to  provide  statistical  retrievals.  A  simulation 
study  was  then  performed  using  subsets  of  a  group  of  1200 
atmospheric  temperature  and  water  vapor  profiles.  For  realistic 
noise  conditions  total  precipitable  water  amounts  with  an  RMS 
error  of  .23  (root  mean  squared  error/mean  of  dependent  set) 
was  found  for  a  mid-latitude  set  of  profiles.  This  corresponds 
to  a  fractional  unexplained  variance  (FUV)  of  .12  (mean 
squared  error/variance  of  the  dependent  set) .  The  profiles 
obtained  had  RMS  errors  below  .4  at  most  levels  below  300  mb, 
corresponding  to  FUV's  from  .18  to  .34. 

Two  non-linear  relaxation  improvement  techniques,  a  fixed  level 
correction  scheme  and  an  EOF  relaxation  scheme,  were  tested  for 
their  ability  to  improve  the  first  guess  results.  Significant 
improvements  in  accuracy  were  obtained  at  most  levels  where  the 
SSH/2  channels  were  sensitive.  Measured  in  terms  of  FUV  the 
improvements  were  generally  .07  or  greater.  Of  the  two 
techniques  that  have  been  studied  the  EOF  approach  yielded  more 
stable  results,  particularly  at  pressures  below  300  mb. 
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APPENDIX  A 


RAPID  ALGORITHM  FOR  SSH/2  TRANSMITTANCE 

1 .  Introduction 

The  inversion  of  the  radiative  transfer  equation  to  obtain  tempera¬ 
ture  or  absorber  amount  by  a  physical  retrieval  method  requires 
that  first  one  be  able  to  solve  the  forward  problem:  given  the 
vertical  structure  of  temperature  and  absorber (s)  determine  the 
radiance  that  would  be  measured  by  each  of  the  channels  of  the 
instrument  in  question.  If  the  assumption  of  local  thermodynamic 
equilibrium  (L.T.E.)  is  valid,  and  scattering  is  unimportant,  then 
the  problem  reduces  to  the  accurate  determination  of  transmittances 
for  the  instrument  channels. 

The  calculation  of  transmittances  can  be  obtained  accurately  by 
the  computationally  expensive  line-by-line  technique.  With  this 
method  the  primary  source  of  error  is  uncertainties  in  the  line 
parameters,  and  lack  of  knowledge  of  the  continuum  absorption. 

If  the  accuracy  of  the  line-by-line  method  is  not  adequate,  empiri¬ 
cal  corrections  can  be  made  if  adequate  ground  truth  data  are  avail¬ 
able.  The  lengthy  computations  in  the  line-by-line  technique, 
however,  preclude  its  use  in  obtaining  the  large  number  of  trans¬ 
mittances  required  by  a  physical  inversion  method. 

A  computationally  efficient  method  for  determining  atmospheric 

transmittances  of  the  SSH/2  was  thus  developed.  This  rapid 

algorithm  uses  a  line-by-line  program  to  generate  a  set  of  depend- 

dent  transmittances  for  twenty  five  model  atmospheres.  The  line- 

by-line  program  was  provided  by  Goddard's  Laboratory  for  Atmos- 
7 

pheric  Sciences  and  modified  and  adapted  for  use  on  our  system. 
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The  twenty-five  dependent  profiles  were  used  to  generate  a  multi¬ 
variate  least  squares  model  which  is  able  to  quickly  calculate  the 
SSH/2  transmittances  (and  thus  the  observed  radiances)  with  suf¬ 
ficient  accuracy  for  our  purposes.  The  terms  of  the  least  squares 
model  were  chosen  by  a  combination  of  physical  intuition  and  trial 
and  error.  Once  coefficients  for  the  model  were  derived  employing 
the  dependent  data  test,  a  test  was  performed  with  twelve  widely 
varying  independent  profiles.  The  details  of  the  model  and  an 
evaluation  of  its  accuracy  are  given  in  the  following  paragraphs. 

2 .  Generation  of  Dependent  and  Independent  Transmittance  Data  Sets 

The  modified  line-by-line  transmittance  program  was  used  to  generate 
transmittances  for  a  sample  of  25  dependent  and  12  independent  pro¬ 
files  with  which  the  rapid  algorithm  was  generated  and  tested.  The 
basis  for  this  test  was  a  set  of  1200  profiles  of  temperature  and 
water  vapor  obtained  from  the  National  Environmental  Satellite 
Service."1'  This  set  contains  a  diverse  set  of  profiles  with  400  pro¬ 
file  subsets  each  from  mid-latitude,  arctic,  and  tropical  atmos¬ 
pheres.  Means  and  standard  deviations  were  computed  for  the  entire 
set  and  for  each  400  profile  subset  and  are  given  in  Table  4.1  and 
4.2. 

For  the  dependent  data  set  of  profiles  it  was  desired  to  account 
for  a  wide  range  of  possible  variations  in  the  atmosphere.  This 
could  be  assured  by  taking  a  large  number  of  realistic  profiles 
from  the  1200  profile  tape,  100  or  more  for  each  channel.  An 
"exact"  transmittance  calculation  of  100  atmospheric  profiles  for 
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the  eight  channels,  where  the  width  of  each  channel  is  30-40  cm  , 
requires  a  large  amount  of  computational  time.  Instead  we  con¬ 
structed  25  artificial  profiles  that  contained  a  wide  variation  in 
both  temperature  and  humidity. 

The  twenty  five  artificial  profiles  were  constructed  as  follows: 

First  a  set  of  5  temperature  profiles  consisting  of:  (1)  the  mean 

of  the  1200  profile  set;  (2)  a  profile  reduced  by  one  standard 
deviation  (s.d.)  at  each  level  from  the  mean;  (3)  a  profile  vary¬ 
ing  from  one  s.d.  above  the  mean  at  the  top  to  one  s.d.  below  the 
mean  at  the  bottom;  (4)  a  profile  varying  from  one  s.d.  below  the 
mean  to  one  s.d.  above  the  mean  at  the  bottom;  and  (5)  a  profile 
everywhere  increased  by  one  s.d.  from  the  mean. 

Second,  a  set  of  5  water  vapor  profiles  were  constructed  as  above, 
but  a  value  80%  of  the  mean  mixing  ratio  at  each  level  was  used 
instead  of  the  standard  deviation. 

Finally,  the  twenty  five  artificial  atmospheres  were  constructed 
by  taking  all  possible  combinations  of  the  above  five  temperature 
and  five  moisture  profiles. 

It  must  be  noted  that  not  all  profiles  so  constructed  are  realistic 
in  the  sense  that  relative  humidities  greater  than  100%  can  and  do 
occur.  However,  since  the  physics  of  absorption  is  dependent  on 
absolute  absorber  amount,  and  not  its  relative  saturation,  and  the 
purpose  of  the  profiles  is  to  generate  a  linear  regression  model, 
this  should  not  be  a  problem. 
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The  independent  data  set  was  chosen  by  selecting  four  profiles  from 
each  of  the  three  groups  on  the  tape.  The  transmi ttances  for  SSH/2 
channels  7-14  were  then  calculated  for  the  dependent  and  independ¬ 
ent  profiles  and  saved  for  later  use. 

3 .  Linear  Regression  Model 

The  effective  layer  optical  depth  was  predicted  with  a  regression 
model.  For  the  layer  p^  to  the  effective  layer  optical 

depth  is  defined  as  follows: 

K.  =  -In  {t  (Pi)A  (Pi_1)  }  (Al) 

For  a  single  frequency  the  effective  layer  optical  depth  is  identi¬ 
cal  to  the  layer  optical  depth: 

Ki  =  -In  {T(Pi  to  Pi_1)}  (A2) 

but  for  the  wide  channels  of  the  SSH/2,  these  values  differ  con¬ 
siderably  due  to  the  so-called  "memory  effect".  Even  so  the  memory 
or  influence  of  higher  layers  on  the  effective  layer  optical  depth 
is  much  less  than  the  effect  of  absorber  amount  and  temperature 
within  the  layer. 

The  following  terms  for  the  regression  of  Ki  were  considered: 


Symbol 

Units 

Description 

AUi 

g/cm^ 

Integrated  H2O  layer  amount 

ATi 

°  K 

Layer  mean  temperature 
difference  from  standard 

temperature . 

AUjATi 

(g°K) /cm^ 

Temperature  weighted 
layer  H2O  amount 
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Symbol 


Units 


Description 


Total  H2O  from  top  of 
atmosphere  to  level  i. 


H^O  -  pressure  -  temperature 


The  least  squares  solution  for  could  thus  be  expressed: 


(A3) 


where  the  constants  a-f  are  to  be  determined  by  a  least  squares 
regression  procedure  for  each  level  and  every  channel.  The  term  f 
is  a  constant  factor  that  serves  to  reduce  any  bias  in  the  pro¬ 
cedure  . 

Preliminary  tests  run  with  several  of  the  SSH/2  channels  made  clear 
that  all  of  the  suggested  terms  were  significant  in  most  cases  ex¬ 
cept  the  term  AT^ .  Significance  was  determined  by  using  an  f  test 
to  calculate  P(Hq),  the  probability  that  the  regression  coefficient 
equals  zero.  The  reason  the  term  AT^  did  not  pass  this  test,  while 
the  combination  term  Alb  AU^  did  pass,  is  that  channels  7-14  of  the 
SSH/2  have  almost  all  of  their  absorption  by  H2O.  Variations  in 
temperature  with  small  amounts  of  water  vapor  present  would  have  a 
small  effect,  while  variations  in  temperature  at  high  humidities 
would  have  a  large  effect. 

The  terms  T*  and  are  included  to  account  for  the  "memory"  ef¬ 
fect  on  the  atmosphere  and  were  found  significant  in  most  cases. 

The  top  several  layers  of  the  atmosphere  consistently  gave  bad 
fits.  This  was  felt  to  be  a  result  of  the  relatively  small  amount 
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of  absorption  above  50  mb.  For  these  layers  a  simple  two  term 
regression  was  used 

Ki  =  a  AUi  +b  (A4) 

One  further  change  was  made  to  the  regression  model  (B3) .  There  is 
a  physical  reason  to  believe  that  the  dependence  of  optical  depth 
is  not  always  a  linear  function  of  absorber  amount.  Theory  pre¬ 
dicts  a  variation  of  K  %  where  y  =  1  in  the  case  of  weak  absorp¬ 
tion  (the  "weak  line  limit")  and  y  =  .5  in  the  case  of  strong  ab¬ 
sorption  (the  "strong  line  limit").  The  terms  AU-[ ,  AUj[  AT^  and  U-[ 

were  replaced  by  AU..1,  au^-at^  and  U  3i.  To  simplify  matters  we 

chose  yi  =  Y2  =  Y3  =  y  and  the  gammas  were  selected  by  an  iterative 
procedure  that  optimized  the  percent  variance  explained  by  the 
regression  model.  The  variations  in  the  gammas  were  restricted  to 
steps  of  .1.  A  more  sophisticated  procedure  would  allow  the  selec¬ 
tion  of  different  gammas,  and  would  not  restrict  them  to  integral 
multiples  of  .1.  Future  versions  of  the  rapid  algorithm  may  in¬ 
clude  these  enhancements. 


4 .  Generation  and  Testing  of  the  Rapid  Algorithm  Coefficients 
The  final  model  selected  for  the  rapid  algorithm  is, 

Ki  =  aAuT  +  b AuT  AT^  +  CUT  +  dT*  +  e  (A5) 


and  the  transmi ttances  x (Pj)  are  constructed  as  follows. 


T(P  )  =  exp  (-  ]T 


i=l 


V 


Coefficients  were  generated  for  the  eight  water 
for  the  24  level  coordinate  system  described  in 


(A6) 

vapor  channels  7-14 
Section  4.4. 
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The  most  important  test  of  the  rapid  algorithm  is  the  accuracy  of 
the  brightness  temperatures  (T^)  and  radiances  (r)  generated  with 
it.  A  comparison  was  made  between  r  and  Tg  generated  by  the  rapid 
algorithm  and  the  exact  method;  the  results  are  shown  in  Table  A1 
for  both  the  dependent  and  independent  data  sets  along  with  the 
noise  equivalent  ATg  of  the  SSH/2. 

The  mean  error  of  Tg  and  r  gives  the  bias.  The  root-mean-square 
error  is  a  measure  of  the  absolute  size  of  the  error  without  the 
bias  removed.  A  subsequent  correction  for  bias  in  T_,  and  r  values 
can  reduce  this  error  further.  As  expected,  the  errors  are  smaller 
in  the  dependent  data  set  than  in  the  independent  data  set.  The 
bias  of  most  channels  is  less  than  the  rms  error  but  is  still 
probably  worth  correcting. 

The  most  critical  comparison  is  between  the  instrument  noise  equiv¬ 
alent  ATg  (NEATg)  and  the  independent  data  set  rms  error.  For  most 
channels  these  two  quantities  are  comparable.  These  results  are 
shown  in  Table  Al.  Some  problems  were  encountered  with  channels 
12  and  13,  however,  where  the  errors  were  somewhat  greater  than 
twice  the  NEATg. 

The  instrument  induced  noise  is  generally  much  less  than  the  so- 
called  "atmospheric"  noise:  errors  introduced  by  inexact  correc¬ 
tion  for  clouds  in  the  field  of  view,  uncertainties  in  the  line 
parameters,  the  water  vapor  continuum  assorption,  and  problems 
with  the  radiative  transfer  equation. 
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CHANNEL  NUMBER 

(  CODE) 

MEAN 

tb 

ERROR 

(°K) 

RMS  ERROR 

tb  (°k) 

INSTRUMENT  NOISE 
EQUIVALENT  ATg  (°K) 

independent  dependent 

independent  dependent 

7 

(E7) 

-0.04 

0.00 

0.05 

0.07 

0.03 

8 

(FI) 

0.04 

0.01 

0.06 

0.02 

0.12 

9 

( F5) 

0.04 

0.01 

0.08 

0.03 

0.12 

10 

(F6) 

0.04 

0.00 

0.15 

0.03 

0.14 

11 

( F4) 

0.02 

0.00 

0.12 

0.03 

0.06 

12 

(F3) 

0.03 

0.00 

0.26 

0.05 

0.11 

13 

(F2) 

-0.05 

-0.01 

0.35 

0.07 

0.19 

14 

(F8) 

-0.11 

-0.01 

0.36 

0.07 

0.47 

MEAN 

ERROR  IN 

RMS 

ERROR  IN 

CHANNEL  NUMBER 

RADIANCE,  (%) 

RADIANCE,  (%) 

independent  dependent 

independent  dependent 

7 

(E7) 

-0.07 

-0.01, 

0.10 

0.12 

8 

(FI) 

0.07 

0.01 

0.10 

0.03 

9 

(F5) 

0.07 

0.02 

0.13 

0.04 

10 

(F6) 

0.06 

0.00 

0.26 

0.05 

11 

(F4) 

0.03 

0.01 

0.21 

0.04 

12 

(F3) 

0.05 

-0.01 

0.46 

0.08 

13 

(F2) 

-0.10 

-0.02 

0.63 

0.13 

14 

(F8) 

-0.20 

-0.03 

0.67 

0.13 

Table  A-l  Errors  in  Calculated  Brightness  Temperatures 
Caused  by  Using  the  Rapid  Transmittance 
Algorithm  for  Dependent  and  Independent  Sets 
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The  wide  range  of  profiles  in  the  independent  data  set  provided  a 
stringent  test  of  the  rapid  algorithm.  The  range  in  total  inte¬ 
grated  water  vapor  amount  from  the  driest  to  wettest  profile 
spanned  two  orders  of  magnitude.  This  relatively  simple  algorithm 
performed  quite  well  over  this  extreme  variation. 


5 .  Summary 

An  adequate  rapid  algorithm  for  the  purposes  of  this 
developed  and  tested.  Since  transmittances  and  radia 
from  the  rapid  algorithm  will  be  considered  as  truth 
guess  retrieval  and  relaxation  procedure,  it  is  only 
the  behavior  of  the  rapid  algorithm  with  temperature 
variations  approximates  that  of  the  exact  procedure; 
demonstrated  by  the  independent  data  test. 
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